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2$ (57) Abstract: A system of taking images of different sensitivities at the same time uses both an image sensor, and an auxiliary part 
^ to the image sensor. The image sensor element can be a photogate, and the auxiliary part can be the floating diffusion associated with 
2 the photogate. Both the photogate and the floating diffusion accumulate charge. Both are sampled at different times. The floating 

diffusion provides a lower sensitivity amount of charge than the photogate itself. The system can have a photogate and floating 
^ diffusion in each pixel along with a select transistor, a reset transistor, and a follower transistor. All of this circuity can be formed of 

CMOS for example. The system can also operate in a column/parallel mode, where each column of the photo sensor array can have 
^ a column signal processor which samples and holds the reset signal, the floating diffusion signal and the photogate signal. 
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DUAL SENSITIVITY IMAGE SENSOR 

This application claims priority from Provisional 
application no 60/139345, filed 6/15/99. 

BACKGROUND 



The dynamic range of a typical CMOS image 
10 sensor is between 65 and 75dB. The scene dynamic range, 
however, may extend over more than 5 orders of magnitude. 
If the scene dynamic range exceeds the sensor dynamic 
range, then portions of the image may be clipped or 
distorted in the darkest or brightest areas of the scene. 
15 Techniques for extending dynamic range have 

included using both non-linear sensors and linear 
sensors. The non-linear sensors may cause image lag, 
have a large pixel size, cause inflexible or destructive 
compression, loss of contrast, increased noise or long 
20 integration time. Linear sensors may have excellent 

contrast and improved noise processing. They may also 
produce excellent opportunities for post -processing, 
since the output is typically directly related to the 
input . 
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A high dynamic range linear sensor often takes 
several integrations of the same scene. Each integration 
has a different integration time. The varying 
sensitivity of the different integrations can provide 

5 more information about the scene. When each integration 
is completed, each pixel may be accessed several times to 
obtain all the information. This necessity to access the 
pixels may decrease the frame rate of the sensor. A 
frame memory may also be necessary to store the results 

10 of the integration temporarily. 

SUMMARY 

The present system uses obtains two integrations of 

t 

the same image, at the same time, using a photoreceptor, 
15 and the auxiliary part for the photoreceptor. 

An embodiment discloses using a photogate which has 
an associated floating diffusion used. Both the 
photogate and the floating diffusion simultaneously 
acquire information about the image. The photogate may 
20 be more efficient and produces a higher sensitivity value 
than the floating diffusion. In this way, both a high 
and a low sensitivity version of the image can be 
obtained. The information may have an increased dynamic 
range . 

SL 
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BRIEF DESCRIPTION OF THE DRAWINGS 

These and other aspects will now be described in 
detail with reference to the accompanying drawings. 
5 Figure 1A shows the layout of a CMOS image sensor 

array including the image acquisition part and the signal 
processing part; 

Figure IB shows a circuit diagram of a single pixel 
and a single part of the column signal processor; and 
10 Figure 2 shows a diagram illustrating the flow of 

operation. 

DETAILED DESCRIPTION 

The present application describes using a 
15 photoreceptor of a type that has an associated part that 
stores charge. The photoreceptor can include a photogate 
and the associated part can be a floating diffusion that 
stores charge from the photogate. This can facilitate 
obtaining two images of the same scene at the same time. 
20 The two images have different sensitivities. It is 

recognized by the present inventors that the photogate 
pixel actually has two electron collecting areas. The 
photogate itself collects electrons. The floating 

i 3 
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diffusion area also collects electrons, but does so at a 
lower efficiency, as compared with the photogate. 

Hence, during the integration period, the photogate 
area generates a higher sensitivity signal, and the 

5 floating diffusion generates a lower sensitivity signal. 
The lower sensitivity signal may have an integration time 
which is equal to or less than the integration time of 
the higher sensitivity signal. The lower sensitivity 
node is 30 to 40 times less sensitive than the high 

10 sensitivity node. This sensitivity, however, can vary 

depending on the ratio between photogate area and area of 
the floating diffusion. Different pixels can be designed 
with different ratios. These can be determined, for 
example, by trial and error. 

15 Figure 1A shows an overall layout of the sensor 

chip. A single silicon substrate 99 has integrated 
therein a photosensor array 100 which includes a 
plurality of pixel photosensor elements arranged in rows 
and columns. Each of the pixels, such as 102, preferably 

20 has the same structure. The same substrate 99 also 
includes an image processor part 110, formed of a 
plurality of circuits 112. Each of the image processor 
circuits preferably has identical structure. Also 
integrated on the chip 9 9 is a controlling element 12 0, 

4 
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which produces control signals that control the flow of 
the operation on the chip. 

Each of the transistors on the substrate are 
preferably formed of MOS type circuit elements. The 

5 control structure can be CMOS. 

Figure IB shows a detailed schematic of the 
structure of the pixels 102 and an associated processing 
circuit 112. The signals described herein are produced 
by the control circuit 120, which can be a small 

10 processor, or can be hardwired logic, which is created 
using hardware definition language. The system 
preferably uses a photosensor of a type which has an 
associated charge storage part. One recognition of the 
present application is that this associated charge 

15 storage part will also integrate charge from incoming 
light. However, the charge integration may be less 
efficient than the actual photoreceptor. In this 
embodiment, the photoreceptor is a photogate 150, which 
has an associated node 151. The node 151 is maintained 

20 separated from a floating diffusion 152. A transfer gate 
154 separates the charge stored in the photogate 150 from 
the floating diffusion 152. The TX gate is held at a 
fixed voltage of about 1.2 volts, which is a slightly 
"ON" state. This forms a barrier to the charge under the 
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photogate, when the photogate is biased high, say at 5 
volts. When the photogate is pulsed low, e.g., to 0 
,. volts, the TX gate forms a channel, allowing the charge 
to pass to the floating diffusion. The control of the 
5 photogate voltage PG is produced by the control circuit 
120. 

The level of the floating diffusion can be adjusted 
by the reset transistor 155. The reset signal RXT 
connects the reset transistor to the voltage Vaa, which is 

10 a reset voltage. The level on floating diffusion 152 is 
also buffered by a follower 158, and can be sampled. A 
row select transistor 160 is actuated by the control 
circuit 120 to select that specified row of pixels. A 
plurality of other row select transistors from different 

15 rows are connected to the node 162 . Only one row is 
preferably selected at any one time. Each column of 
pixels is associated with a column signal processor shown 
as 112. The column signal processor processes the 
signals described herein. As shown, three sample and 

20 hold circuits are provided. A first sample and hold 
circuit 165 stores the reset level. The SH_RST signal 
from the control circuit 120 turns on the transistor 166 
thus storing the reset level into the capacitor 168. 
Analogously, the other sample and hold circuit 170 stores 
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the floating diffusion level, and the third sample and 
hold circuit 175 stores the photogate signal. An 
arithmetic processor 175 can be provided to provide any 
desired combination of these signals. 

5 The low sensitivity signal can correspond to the 

floating diffusion values subtracted from the reset 
value. The photogate value can correspond to the 
photogate sample and hold level, subtracted from the 
floating diffusion value, and optionally also subtracted 

10 from the reset value. Each of the pixels in a specific 
row receives the same row select signal to the base of 
the transistor 160 that is associated with each pixel in 
that row. This turns on all of the transistors in a row 
at once, thereby selecting the entire row at once. All 

15 transistors in all other rows are maintained off. One 
value from each column is thereby obtained at any time, 
into a corresponding signal processing unit 112. This 
allows the system to operate in a so-called 
column/parallel mode wherein an entire row of pixel 

20 outputs are obtained. 

The operation occurs as shown in Figure 2. During 
each cycle, the system is first reset as shown as 250, to 
a reset level. The reset value is sampled at 255. The 
reset value is sampled during this time by selecting the 

i 
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row, and actuating the SH_RST signal to provide the reset 
signal onto the associated capacitor 168. The photogate 
mode integration begins at the time of reset shown as 
240. The floating diffusion integration begins at time 

5 245, after the sample reset value is detected. 

At the end of the integration time, the floating 
diffusion 152 has integrated charge. This is sampled at 
time 200, to obtain the value of the FD sample. This 
value is then actuated into the sample and hold circuit 

10 170. The photogate also includes charge. After sampling 
the floating diffusion, the transfer gate 154 is actuated 
by producing the signal TX from the controller. This 
dumps the charge from the photogate 150 into the floating 
diffusion and the floating diffusion is again sampled at 

15 210 to obtain the photogate value. This value is then 
held in the sample and hold 175. 

Both the photogate and the floating diffusion 
integrate during the same time period. At least 80% of 
the integration time is preferably common. The time of 

20 integration of the FD may be slightly less, to 

accommodate sampling values on the floating diffusion. 
However, since the time of integration is mostly common, 
the same scene is imaged. 



1 
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Although only a few embodiments have been disclosed 
in detail above, other embodiments are possible. For 
example, while the embodiment disclosed above describes 
using the photogate, it could also be done with other 
kinds of light sensing devices. An important feature is 
that two different levels of charge, at two different 
sensitivities, are sampled into different node at least 
partly simultaneously. 

All such modifications are intended to be 
encompassed within the following claims. 



9 
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What is claimed is : 

1. An image sensor comprising: 

a plurality of image sensing pixel portions; and 
5 a plurality of image processing portions; 

each said image sensing pixel portion including a 
photoreceptor, which has a first sensitivity to light and 
produces charge based on an amount of incident light, and 
an associated portion for said photoreceptor, which 
10 associated portion selectively receives charge from said 
photoreceptor but which by itself has a second 
sensitivity to light different than said first 
sensitivity to light and produces charge based on an 
amount of incident light, an in-pixel follower 
15 transistor, and an in-pixel select transistor; and 

wherein each said image processing portion includes 
circuitry that produces an output indicative of both an 
amount of charge received by said associated portion, and 
an amount of charge received by said photoreceptor. 

20 

2 . A sensor as in claim 1 wherein said 
photoreceptor is a photogate, and said associated portion 
is a floating diffusion associated with said photogate in 
each said pixel . 

10 

A0/-Z7/05, EAST Version: 2.0.1.4 



WO 00/78034 



PCT/US00/16633 



3 . A sensor as in claim 2 further comprising a 
transfer gate, located between said photogate and said 
floating diffusion, which separates charge stored in said 
5 photogate from said floating diffusion. 



4. A sensor as in claim 2 further comprising, in 
each said pixel, a reset transistor, connected between a 
reset level and said floating diffusion, and which 
10 operates to reset a value of said floating diffusion to a 
specified level. 



5 . A sensor as in claim 2 wherein each of said 
photogate, said floating diffusion, and said in-pixel 

15 transistors are formed of MOS-type technology. 

6. A sensor as in claim 2 wherein said image 
processing portion includes a plurality of sample and 
hold circuits, 

20 

7 . A sensor as in claim 6 wherein said plurality of sanple and 
hold circuits include a first sanple and hold circuit storing a reset 
level, a second sanple and hold circuit storing a photogate level, and 
a third sanple and hold circuit storing a floating diffusion level. 



// 
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8 . A sensor as in claim 7 further comprising a 
circuit which outputs a first, low sensitivity output 
indicative of a difference between said floating 
diffusion level and said reset level and a second, high 
sensitivity output indicative of a difference between 
said photogate level and said reset level. 

! 

9. A sensor as in claim 2 further comprising a 
controlling circuit, operating Ito control times of 
integration of said photogate and said floating 
diffusion, such that said floating diffusion integrates 
for a same time or less time than an integration time of 
said photogate, and such that at least part of the time 
of integration of said floating diffusion overlaps a time 
of integration of said photogate. 

10. A sensor as in claim 2 wherein there are a 
plurality of said image processing circuits, each of 
which are substantially identical, each image processing 
circuit associated with an entire column of pixels. 

11. A sensor as in claim 10 further comprising a 
control circuit, which produces a row select signal to 
each of a plurality of pixels in a single row, to provide 

a 
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outputs from said each of said plurality of pixels to an 
individual image processing circuit. 

12. A method of imaging, comprising: 

5 imaging a scene by simultaneously obtaining both a 

high sensitivity signal and a low sensitivity signal in 
each of a plurality of pixels of an image sensing device, 
using an integration period which is at least 80% 
overlapping for both high sensitivity signal and a low 

10 sensitivity signal, both said high sensitivity and low 
sensitivity signals being obtained within the pixel 
itself; and 

outputting both of said high sensitivity signal and 
low sensitivity signal. 

15 

13 . A method as in claim 12 wherein said obtaining 
comprises providing both a photosensor and an associated 
device that is associated with said photosensor which 
normally obtains charge from said photosensor, said 

20 photosensor obtaining the high sensitivity signal and 
said associated device obtaining the low sensitivity 
signal . 



/3 
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14. A method as in. claim 13 wherein said 
photosensor is a photogate and said associated device is 
a floating diffusion which receives charge from said 
photogate . 

15. A method as in claim 14 further comprising: 
obtaining a signal by determining a reset level of 
the floating diffusion; 

determining an integrated value indicating the level 
of the floating diffusion, obtained by integrating a 
scene for a first specified time; 

obtaining a second integrated level, obtained by 
integrating the scene in said photogate for a second 
specified time; and 

outputting differences between said reset, 
photogate, and floating diffusion levels. 

16. A method as in claim 15 wherein said first 
integration time of said floating diffusion is less than 
or equal to said second integration time of said 
photogate . 



i 
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17. A method as in claim 15 wherein said obtaining 
and determining comprises first sampling said reset 
level, then sampling said floating diffusion level, and 
then transferring a photogate level to said floating 

5 diffusion level and sampling said floating diffusion 
level again to obtain a photogate level. 

18. A photosensor device comprising: 

a single continuous substrate of semiconductor 
10 material; 

an image sensor portion, formed on said substrate of 
semiconductor material, said image sensor portion 
including an array of image sensor pixels, including 
photoreceptors, arranged in rows and columns, each of 

15 said pixels formed of an MOS electronic component; 

an image processing portion, also formed on said 
substrate, and connected to said image sensor portion 
such that each pixel can be selectively coupled to a 
specified portion of said image processing portion, said 

20 image processing portion including a plurality of 

transistors, each of which are formed of MOS transistors, 
and a plurality of which of formed of CMOS transistors; 
and 

if 
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a control portion, controlling integration of 
photoreceptors in said image sensor portion including 
times of said integrations, and also controlling 
connections between said image sensor and said image 
5 processing portion, and controlling timing of operations 
in said image processing portion, 

each of said pixels and said image sensor including 
a photoreceptor, a transfer gate, and an associated 
portion that selectively receives charge from said 

10 photoreceptor via said transfer gate, a reset transistor, 
a follower transistor, coupled to said associated 
portion, and operating to buffer the value of said 
associated portion, and a selection transistor, coupled 
to said control portion, said control portion controlling 

15 said selection transistor to produce an output from the 
specified pixel such that a level of the associated 
portion is first sensed, and then values are coupled from 
said photoreceptor into said floating diffusion and to 
sample values on said floating diffusion, said values 

20 provided to said image processing portion. 



19. A device as in claim 18 wherein said image 
processing portion includes a plurality of sample and 
hold circuits therein, including a reset sample and hold 
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which samples a reset level, associated device sample and 
hold circuit which samples thei level of said associated 
device, and a photoreceptor sample and hold which samples 
a level of said photoreceptor. 

5 

20. A device as in claim 19 further comprising a 
subtraction element which subtracts said reset level from 
said associated level to produce the low sensitivity 
signal and subtract at least one other level from said 
10 photoreceptor signal to produce a high sensitivity 
signal . 



21. A device as in claim 19 wherein said 
photoreceptor includes a photogate and said associated 
15 device includes a floating diffusion associated with said 
photogate . 



22. A device as in claim 21 wherein said image 
processing portion includes a plurality of sample and 
20 hold circuits, a first sample and hold circuit sampling a 
reset level, a floating diffusion sample and hold circuit 
sampling a level in the floating diffusion prior to 
transfer of photogate charge thereto and a photogate 
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sample and hold circuit sampling a level on the floating 
diffusion after transfer of photogate charge thereto. 

23. A device as in claim 22 wherein said sample and 
5 hold circuits are controlled by said control portion. 

24. A device as in claim 18 wherein said image 
processing portion includes a plurality of image 
processing circuits, arranged such that one image 

10 processing circuit is associated with an entire column of 
said image sensor pixels, and said control circuit 
controls said image sensor pixels to select an entire row 
of image sensor pixels at one time, said entire selected 
row being coupled simultaneously to different ones of 

15 said image processing circuits to determine values 

therefrom to thereby operate to output an entire column 
in parallel . 

25. A device as in claim 18 further comprising a 
20 reset transistor in each of said pixels. 



it 
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26. A device as in claim 21 wherein said control 
portion controls integration times of both said photogate 
and said floating diffusion by controlling the reset 
transistor to said floating diffusion to first reset said 

5 floating diffusion, theT | contro1 said select transistor 
to sample the level on said floating diffusion. 

f 

27. A method of obtaining images of different 
sensitivities, comprising: 

10 allowing integration to occur in a floating 

diffusion associated with a photogate; 

first sampling a level of integration which has 

occurred in said floating diffusion and then transferring 

charge from said photogate to said floating diffusion and 
15 sampling the level that has occurred in said photogate; 

and 

outputting two values indicative respectively of a 
low sensitivity signal and a high sensitivity signal that 
were integrated at substantially the same time, based on 
20 said floating diffusion signal and said photogate signal. 

28. A method as in claim 27 wherein said low 
sensitivity signal corresponds to said floating diffusion 
signal subtracted from said reset signal. 



if 
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29. A method as in claim 27 wherein said high 
sensitivity signal corresponds to said photogate signal 
subtracted from said floating diffusion signal. 

30. A method as in claim 27 wherein said floating 
diffusion is 30-40 times less sensitive to light than 
said photogate. 

31. A method of obtaining an image, comprising: 
obtaining two different signals of different levels, 

from two different photosensing devices of two different 
sensitivities, which are substantially simultaneously 
integrated; and 

outputting first and second sensitivity signals, 
based on said two different signals. 

32. A method as in claim 31, further comprising, 
storing said two different signals into respective sample 

20 and hold circuits. 



10 
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